Detection and Estimation of Omni-Directional Pointing Gestures Using Multiple Cameras
نویسندگان
چکیده
We propose a multi-camera system that can detect omni-directional pointing gestures and estimate the direction of pointing. In general, when a human points a t something, their target exists directly in front of the direction they are facing. Therefore, we regard the direction of pointing as the direction represented by the straight line that connects the face position with the hand position. First, the multiple cameras detect the face region by skin colors and estimate the face direction with the discrete face direction feature classes. Second, we estimate the precise direction that the subject is facing with the integrated information from multiple cameras and decide which camera captures the frontal view of the face the best. This camera is labeled the center camera. Third, we select a pair of cameras on both sides of the center camera as a stereo camera and detect the spatial positions of the face and hand. Finally, the target that the subject is pointing to is found on the straight line that connects the face position with the hand position. Experiments show that out system can achieve a mean error of 1.94" with a variance of 4.37 throughout the pointing direction.
منابع مشابه
Investigation on the Effect of Different Parameters in Wheeled Mobile Robot Error (TECHNICAL NOTE)
This article has focused on evaluation and identification of effective parameters in positioning performance with an odometry approach of an omni-directional mobile robot. Although there has been research in this field, but in this paper, a new approach has been proposed for mobile robot in positioning performance. With respect to experimental investigations of different parameters in omni-dire...
متن کاملVisual SLAM with a Multi-Camera Rig
Camera-based simultaneous localization and mapping or visual SLAM has received much attention recently. Typically single cameras, multiple cameras in a stereo setup or omni-directional cameras are used. We propose a different approach, where multiple cameras can be mounted on a robot in an arbitrary configuration. Allowing the cameras to face in different directions yields better constraints th...
متن کاملDetection and Estimation of Pointing Gestures in Dense Disparity Maps
In this paper we describe a real-time system for detecting pointing gestures and estimating the direction of pointing using stereo cameras. Previously, similar systems where implemented using color-based blob trackers, which relied on effective skin color detection; this approach is sensitive to lighting changes and the clothing worn by the user. In contrast, we used a stereo system that produc...
متن کاملLinear Distributed Localization of Omni-Directional Camera Networks
Localization, estimating the positions and orientations of a set of camera nodes, is a critical first step in camera network applications such as geometric estimation and scene reconstruction. We propose a distributed algorithm for camera network localization between multiple omni-directional cameras with sparse overlapping view structure. This procedure involves a distributed variation of the ...
متن کاملEffective Mechatronic Models and Methods for Implementation an Autonomous Soccer Robot
Omni directional mobile robots have been popularly employed in several applications especially in soccer player robots considered in Robocup competitions. However, Omni directional navigation system, Omni-vision system and solenoid kicking mechanism in such mobile robots have not ever been combined. This situation brings the idea of a robot with no head direction into existence, a comprehensi...
متن کامل